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© The present invention makes it possible to ex- 
ecute communication between an image-information 
storage and a terminal even in case they have 
different image formats. An image data delivery re- 
quest transmitted from any of terminais (11a - 11c) 
and received by a receiving portion (13) includes an 
information indicating that the terminal has a source 
format CIF or QCIF. This information is transferred to 
a communication control portion (14) which informs 
an source format control portion (17) of the source 
format CIF or QCIF of the terminal When the termi- 
nal has the CIF source format, the required data 
transmitted from an image-information storage de- 
vice (19) are transmitted through a transmitter por- 
tion to the t rminal. When the t rminal 11d has th 
QCIF source format, a part of the image data trans- 
ferred from the image-information storage d vie 
(19) is extracted and convert d into data of QCIF 
format by the source format control portion (17). Th 
converted data of QCIF source format are th n trans- 



mitted through a transmitting portion (15) to the 
terminal (11d). 
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BACKGROUND OF THE INVENTION 

The present invention relates to an image-in- 
formation format control device and more particu- 
larly to an image-information storage and commu- 
nication system which realizes services for de- 
livering and mailing audio visual information from 
the image-information storage to any of terminals 
over a communication network whereto they are 
connected. 

The terminals are classified into two groups 
having different source formats - CIF (Common 
Intermediate Format) and QCIF (Quarter CIF). 

The CIF has a hierarchical structure comprising 
of 4 hierarchies, i.e., frame, group of blocks (GOB), 
macro-block (MB) and block, and it represents 
such a source format that a luminance sample 
comprises of 352 pixels x 288 lines per frame and 
a chrominance sample comprises of 176 pixels x 
144 lines. 

The QCIF has reduced to 1/2 numbers of pix- 
els and lines respectively in comparison with the 
CIF. 

The operation of the conventional image-in- 
formation storage and communication system will 
be described below: 

Data of each frame comprise of a picture start 
code (PSC), temporal reference (TR), type informa- 
tion (PTYPE), extra insertion information (PEI), 
spare information (PSPARE) (a set of the above- 
mentioned components is called as frame header) 
and following thereafter data of GOB. Each frame is 
divided into 12 GOB for CIF format and 3 GOB for 
QCIF format. 

Data of each GOB comprise of a GOB start 
code (GBSC), group number (GN), quantizer in- 
formation (GQUANT), extra insertion information 
(GEI), spare information (GSPARE) (a set of above- 
mentioned components is called as a GOB header) 
and following thereafter data of a macro-biock 
(MB). Each GOB is divided into 33 MBs. 

Data of each MB comprise of a macro-block 
address (MBA), type information (MTYPE), quan- 
tizer information (MQUANT), motion vector data 
(MVD), coded block pattern (CBP) (a set of the 
above-mentioned components is called as a 
macro-block (MB)) and following thereafter block 
data. 1 MB is comprised of 4 blocks of luminance 
blocks and 2 blocks of chrominance. a 

Data of one block comprise of a transform 
coefficient and a code EOB indicating the end of 
block marker. Data of a conversion coefficient are 
comprised of 8 x 8 data. 

Let us suppose a case when a terminal which 
is capable of handling CIF format or QCIF format 
requests the image-information storage to transmit 
an image-information. Data transmitted from the 
terminal over the data channel are received by the 



receiving portion. The received data contain data 
indicating which format CIF or QCIF the terminal 
has and data indicating what kind of the image 
information the terminal requires. The received 

5 data are then sent to the image-information storage 
8 through the interface portion thereof. The image- 
information storage holds data of image-information 
in two different formats CIF and QCIF and can 
transmit the requested image-information data in 

w the format specified by the terminal. 

Besides conventional interactive communica- 
tion services such as telephone, facsimile and so 
on, an audio delivery service being capable of 
storing audio-information in a center of networks 

15 and reproducing it any time at the request has 
recently been provided. With development of digi- 
tal communication networks, which is represented 
by Integrated Services Digital Network (ISDN), it 
has also become possible to utilize image commu- 

20 nication services, e.g., audio visual service. In 
these circumstances, the demand for image-infor- 
mation delivery services increases more and more 
and such services have partly been realized. 

In the conventional image storage and commu- 

25 nication system, the same image is stored in two 
different formats, resulting in considerable waste of 
memory. But, if image-information data are stored 
in only one of formats (i.e., CIF or QCIF), it be- 
comes impossible to communicate with terminals 

30 having a different source format. 

Furthermore, the conventional image-informa- 
tion reproducing system involves such a problem 
that in case when image-information is stored in 
the format CIF in an image-information storage at a 

35 network center and a video data receiving terminal 
can decode video information of the QCIF format 
only, the image data stored in the CIF format can 
not be transmitted from the center to the terminal. 

40 SUMMARY OF THE INVENTION 

It is an object of the present invention to pro- 
vide an image-information format control device for 
use in an image-information storage and commu- 

45 nication system, which realizes image-information 
communication between an image-information stor- 
age and any terminal in a network even when the 
terminal has an image format being different from 
that of the stored image-information, and which, if 

so image-information stored in a data storage portion 
can not be decoded by a receiving terminal, con- 
verts it into data having a size and a format receiv- 
able and decodable at the receiving side. 

It is another object of the present invention to 

55 provide an image-information format control device 
which the application of a source format control 
device enables a conventional image-information 
storage and communication system to store image 
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data only in CIF format system with an effective 
use of its memory and communicate with terminals 
irrespective of difference in image format of the 
terminals. 

It is another object of the present invention to 
provide an image-information format control device 
which a center control device of the system is 
provided with a header converting portion which 
rewrites a header of a source format according to 
an information about communicating conditions in 
case when the stored source format can not be 
received by a receiving terminal for the image 
reproduction; a source format converting portion 
which converts a format of image data into a format 
receivable by the receiving terminal; a code- 
amount control portion which rewrites or extracts a 
part of a screen image-information to obtain an 
image-information of a format and a size receivable 
by the receiving terminal. Conversion of a source 
format from CIF into QCIF can be conducted using 
the center portion data of the image of CIF to 
eliminate the possibility of losing the necessary 
information for users. 

Data transmitted from a terminal and received 
by the receiver portion includes data for identifying 
a source format (CIF or QCIF) of the terminal and 
data for identifying a kind of image-information 
required by the terminal. The format identifying 
information is transferred to the communication 
control portion whereby it is read and further trans- 
ferred to the source format control portion, while 
the data identifying the requested image-informa- 
tion are sent through the interface portion to the 
image-information storage wherefrom the request- 
ed image data in the CIF format are transferred 
through the interface to the source format control 
portion. 

The source format control portion has been 
informed of the image data format (CIF or QCIF) of 
the terminal. Therefore, if the terminal uses the CIF 
format, the data from the image-information storage 
are transmitted through the transmitter portion to 
the receiving terminal without any processing. If the 
terminal uses QCIF format, the source format con- 
trol portion extracts a part of the image data re- 
ceived from the image-information storage, con- 
verts the data into QCIF data that are then transmit- 
ted through the transmitter portion to the terminal. 

Since the system further includes a header 
converting portion for rewriting a header of image- 
information according to the communicating con- 
ditions memorized together with an image data and 
the capability of a receiving terminal in case when 
the image-information stored in the image-informa- 
tion storage can not be decoded by the receiving 
terminal; an image format converting portion for 
converting a format of image data into a format 
receivable by the receiving terminal; and a code 



amount control portion for adjusting an amount of 
coded data to be transmitted, and it can rewrite a 
part of a screen image-information to be of a size 
and a format receivable by the receiving terminal 

5 and then extracts and transmits the rewritten im- 
age-information to the receiving terminal. 

To realize the above-mentioned purposes, the 
present invention was made to provide an image- 
information format control device which includes a 

to transmitter-receiver portion for transmitting and re- 
ceiving image-information data, a source format 
control portion for controlling source formats, an 
interface portion for connecting with an image- 
information storage and a communication control 

75 portion for controlling the above-mentioned portions 
and communications and, which, in case when it is 
impossible to conduct image data communication 
between the image-information storage and a re- 
ceiving terminal because of incompatibility of the 

20 format of the image data stored in the image- 
information storage with the format receivable by 
the terminal, selects a part of the coded image- 
information to compose data having the format 
receivable by the receiving terminal and then trans- 

25 mits said data to the receiving terminals. 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a view showing a conventional image- 
30 information communication system. 

FIG. 2 shows hierarchical structures of conven- 
tional CIF and QCIF formats. 

FIGS. 3A, 3B, 3C and 3D show data structures 
of hierarchies of conventional CIF and QCIF for- 
35 mats. FIG. 4 is a construction view for explaining a 

source format control device embodying the 
present invention. 

FIG. 5 is an explanatory diagram of CIF-to- 
QCIF format conversion according to the present 
40 invention. 

FIG. 6 shows another example of CIF-to-QCIF 
format conversion according to the present inven- 
tion. 

FIG. 7 is a construction view of a source format 
45 control portion shown in Fig. 4. 

FIG. 8 is a view showing another example of 
CIF-to-QCIF format conversion method according 
to the present invention. 

FIG. 9 is a view showing an example of a 
so source format conversion according to the present 
invention. 

PREFERRED EMBODIMENT OF THE INVENTION 

55 Fig. 1 shows a structure of a conventional 
image-information storage and communication sys- 
tem which includes terminals 1a - 1d, a data chan- 
nel 2, a receiving portion 3, a communication con- 
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trol portion 4, a transmitting portion 5, an image- 
information storage 8, an interface portion 6 for 
connecting with the image-information storage de- 
vice 8, and numeral 7 designates a connection 
control portion. 

The terminals 1a - 1d are classified into two 
groups having different source formats - GIF (Com- 
mon Intermediate Format) and QCIF (Quarter CIF). 

The CIF has a hierarchical structure comprising 
of 4 hierarchies, i.e., frame, group of blocks (GOB), 
macro-block (MB) and block as shown in Fig. 2, 
and it represents such a source format that a 
luminance sample comprises of 352 pixels x 288 
lines per frame and a chrominance sample com- 
prises of 176 pixels x 144 lines. 

The QCIF has reduced to 1/2 numbers of pix- 
els and lines respectively in comparison with the 
CIF. A hierarchical structure of data is shown in 
Fig. 3A - 3D. 

Referring now to Fig. 2 and 3A - 3D, the 
operation of the conventional image-information 
storage and communication system will be de- 
scribed below: 

As shown in Fig. 3A, data of each frame com- 
prise of a picture start code (PSC), temporal refer- 
ence (TR), type information (PTYPE), extra inser- 
tion information (PEI), spare information (PSPARE) 
(a set of the above-mentioned components is 
called as frame header) and following thereafter 
data of GOB. Each frame, as shown in Fig. 2, is 
divided into 12 GOB for CIF format and 3 GOB for 
QCIF format. 

As shown in Fig. 3B, data of each GOB com- 
prise of a GOB start code (GBSC), group number 
(GN), quantiser (GQUANT), extra insertion informa- 
tion (GEI), spare information (GSPARE) (a set of 
above-mentioned components is called as a GOB 
header) and following thereafter data of a macro- 
block (MB). Each GOB is divided into 33 MBs as 
shown in Fig. 2. 

As shown in Fig. 3C, data of each MB com- 
prise of a macro-block address (MBA), type in- 
formation (MTYPE), quantiser (MQUANT), motion 
vector data (MVD), coded block pattern (CBP) (a 
set of the above-mentioned components is called 
as a macro-block (MB)) and following thereafter 
block data. 1 MB is composed of 4 blocks of 
luminance blocks and 2 blocks of chrominance. 

As shown in Fig. 3D, data of one block com- 
prise of a transform coefficients and a code EOB 
indicating the end of a block. Data of a transform 
coefficients are comprised of 8 x 8 data as shown 
in Fig. 2. 

Let us suppose a case when a terminal of CIF 
format or QCIF format requests the image-informa- 
tion storage 8 to transmit an image-information. 
Data transmitted from the terminal over the data 
channel 2 are received by the receiving portion 3. 



The received data contain data indicating which 
format CIF or QCIF the terminal has and data 
indicating what kind of the image-information the 
terminal requires. The received data are then sent 

5 to the image-information storage device 8 through 
the interface portion 6 thereof. The image-informa- 
tion storage device 8 holds data of image-informa- 
tion in two different formats CIF and QCIF and can 
transmit the requested image-information data in 

w the format specified by the terminal. 

Besides conventional interactive communica- 
tion services such as telephone, facsimile and so 
on, an audio delivery service being capable of 
storing audio-information in a center of networks 

is and reproducing it any time at the request has 
recently been provided. With development of digi- 
tal communication networks, which is represented 
by Integrated Services Digital Network (ISDN), it 
has also become possible to utilize image commu- 

20 nication services, e.g., audio visual service. In 
these circumstances, the demand for image-infor- 
mation delivery services increases more and more 
and such services have partly been realized. 

Referring to drawings, a preferred embodiment 

25 of the present invention will be described as fol- 
lows: 

Fig. 4 is a construction view for explaining an 
example of image-information storage and commu- 
nication system for video delivery service, which is 

30 provided with a source format control device ac- 
cording to the present invention. The system in- 
cludes terminals 11a - 11d, a data channel 12, an 
image-information storage and a source format 
control portion that comprises a receiving portion 

35 13, communication control portion 14, a transmit- 
ting portion 15, an interface portion 16 for connect- 
ing with the image-information storage device 19 
and a source format control portion 17, a source 
format control device 18 and an image-information 

40 storage device 19. 

Data transmitted from any terminal 11a - 11c 
are received by the receiving portion 13 wherefrom 
a part of the data, which indicates a type of data 
format-CIF or QCIF of the terminal, is sent to the 

45 communication control portion 14 that in turn reads 
the data and transfers them to the source format 
control portion 17. The other part of the data, which 
indicates a kind of image data required by the 
terminal, is transmitted through the interface por- 

50 tion 16 to the image-information storage device 19 
wherefrom the requested image data in the format 
of CIF are transferred through the interface to the 
source format control portion 17. 

The source format control portion 17 has been 

55 informed by the communication control portion 14 
of the type of image data format (CIF or QCIF) 
adopted by the terminal. When the terminal uses 
CIF data, the data of CIF received from the image- 
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information storage device 19 are not subjected to 
any processing and transmitted through the com- 
munication control portion 14 to the terminal. In 
case of the terminal 11d using QCIF data, the data 
of CIF received from the image-information storage 
device 19 are transferred to the source format 
control portion 17 whereby they are partly ex- 
tracted and converted into the data of QCIF which 
are then transmitted to the receiving terminal 11d 
through the transmitting portion 15. 

Fig. 5 is a view for explaining how to convert 
data format into QCIF. 

One of methods for converting an image data 
format from CIF into QCIF, which is applicable in 
the source format control portion 17, is such that a 
frame of CIF is divided into 4 divisions and image 
data contained in one of the divisions, i.e., data of 
GOB (group of blocks) Nos. 1, 3 and 5 are ex- 
tracted from GOB hierarchy and transmitted. The 
data of the other GOBs are not transmitted. In this 
case, a left upper quarter of a screen image of CIF 
format is converted into a screen image of QCIF 
format. 

Fig. 6 is a view for explaining another method 
of converting data format to QCIF. 

The source format control portion 17 stores in 
its memory a plurality of patterns for extracting 
data from CIF format 22, any of which can be 
selected by each terminal. For instance, QCIF for- 
mat 21 patterns comprising GOB Nos. (1,3,5), 
(2,4,6), (7,9,11), (8, 10, 12) respectively are pre- 
viously prepared: when any one of the patterns is 
selected from a terminal, the source format control 
portion 17 transmits data of the selected QCIF 
format to the terminal. 

In an image-information storage device and 
communication system that realizes video-and- 
audio information delivery and mailing services 
over a network connecting terminals to an image- 
information storage device, the embodiment of the 
present invention, as described above, enables the 
system to communicate with the terminals even 
when image data format of the image-information 
storage device differs from that of the terminals. 
Namely, the image-information format control de- 
vice according to the present invention comprises a 
transmitting portion and a receiving portion for 
transmitting and receiving image-information data, 
a source format control portion for controlling 
source formats, an interface portion for connecting 
with an image-information storage device and a 
communication control portion for controlling the 
above-mentioned portions and communications 
and, which, in case when it is impossible to con- 
duct image data communication between the im- 
age-information storage device and a receiving ter- 
minal because of incompatibility of the format of 
the image data stored in the image-information 



storage device with the format receivable by the 
terminal, extracts a part of the coded image-in- 
formation to compose data of the format receivable 
by the receiving terminal and then transmits said 

5 data to the receiving terminals. 

Fig. 7 is a construction view of the source 
format control portion shown in Fig. 4, there are 
shown a data storage portion 31 . an image format 
converting portion 32, a header converting portion 

10 33, a code amount control portion 34, a system 
control portion 35 and a multiplexing and demul- 
tiplexing portion 36. 

First, a communication capability is negotiated 
between image-information storage center and a 

75 motion video terminal at beginning of communica- 
tion there between to get an information of video 
decoding capability of the terminal. The capaility 
information of the terminal is sent from the mul- 
tiplexing and demultiplexing portion 36 to the sys- 

20 tern control portion 35. When a request for re- 
production of an image is received from the termi- 
nal, the system control portion 35 reads requested 
image data from the data storage portion 31 and 
transfers the image data to the image format con- 

25 verting portion 32. The system control portion 35 
also gets an information indicating communicating 
conditions such as a format of image data, which 
has been stored together with the data at the time 
of storing the data. When the video-decoding capa- 

30 bility of the terminal is limited to QCIF and the 
information on the communication conditions of the 
stored image data is CIF, the system control por- 
tion 35 gives the image format converting portion 
32 an instruction for converting the source format 

35 CIF into QCIF. 

The format conversion may easily be per- 
formed by selecting three GOB, e.g., GOBI, GOB3 
and GOBS neighboring to each other from the data 
of format CIF and by rewriting GOB numbers of 

40 them. This method, however, causes such a prob- 
lem that the reproduced image of QCIF is shifted in 
a vertical or horizontal direction with reference to 
the stored image of CIF. Since a screen image 
usually indicates its important object, e.g., a per- 

45 son's figure at the center portion thereof, the 
above-mentioned method may lose the desired im- 
age-information. Accordingly, image format conver- 
sion shall be conducted using a substantially cen- 
ter portion of a stored image of CIF as shown in 

50 Fig. 8. 

Referring to Fig. 9, an example of image format 
conversion is described below in detail: 

Data addressed at MB17 of GOB3 in stored 
image data of CIF is first selected and addressed 
55 at MB1 of GOBI of the image data of QCIF. The 
proceeding data of the center portion of the image 
are sequentially selected and arranged to form an 
image-information of QCIF format. Next, the con- 
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verted data of QCIF is processed by the header 
converting portion 33 that rewrites GOB numbers 
and MB addresses, e.g., MB17 of GOB3 and MBS 
of GOB10 are changed into MB1 of GOBI and 
MB33 of GOB3 respectively. 5 

The image data after rewriting the header are 
transferred to the code amount control portion 34. 
In case when a minimum image interval of image- 
information at storing is the same as that at re- 
producing, there may occur an underflow of trans- w 
mission data of the image converted from CIF into 
QCIF if no adjustment is made in advance. Accord- 
ingly, the code amount control portion 34 adjusts a 
quantity of codes in the image data by inserting 
therein fill bits for denoting absence of data. Last, is 
the processed image data are multiplexed with 
audio data in the multiplexing and demultiplexing 
portion 36 and supplied therefrom into the commu- 
nication network. 

In the above-described embodiment of the 20 
present invention, a screen image-information 
stored in the image-information storage device and 
having a format, which can not be decoded for 
reproduction of the image at a receiving terminal, is 
partly rewritten in such a way that they may have a 25 
size and a format receivable by the terminal, and 
then the converted coded-image data are extracted 
therefrom and transmitted to the terminal. The em- 
bodiment, therefore, includes a header converting 
portion for rewriting a header of the source format 30 
according to an information about communicating 
conditions, which is memorized together with im- 
age data stored, with due consideration of the 
capability of the receiving terminal, an image for- 
mat converting portion for converting the image 35 
format into a format receivable by the receiving 
terminal and a code amount control portion for 
adjusting a quantity of codes in the image data to 
be transmitted to the receiving terminal. 

As many apparently widely different embodi- 40 
ments of this invention may be made without de- 
parting from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in 
the appended claims. 45 

Claims 

1- An image-information format control device 
comprising an image-information storage and 50 
communication system which realized services 
for delivering or mailing audio visual informa- 
tion from the image-information storage to any 
of terminals over a communication network 
whereto they are connected, characterized by 55 
a transmitting portion (15) and a receiving por- 
tion (13) for transmitting and receiving data of 
an image-information, a source format control 



portion (17) for controlling a source format, an 
interface portion (16) for connecting with an 
image-information storage device (19) and a 
communication control portion (14) for control- 
ling the above-mentioned portions, whereby in 
case of impossibility to transmit data of the 
image-information from the image-information 
storage device (19) storing the image-informa- 
tion data to a receiving terminal because of 
incompatibility of the source format of sending 
side with that of the receiving terminal, i.e., the 
image-information storage device (19), the de- 
vice extracts a part of coded image-information 
to compose a format receivable by the termi- 
nal and then transmits the extracted and con- 
verted information to the terminal. 

2. An image-information format control device ac- 
cording to Claim 1, wherein said source format 
control portion (17) holding a plurality of format 
data-patterns and transmits data of a format 
selected by a receiving terminal. 

3. An image-information format control device ac- 
cording to Claim 1, wherein said source format 
control portion (17) is provided with a header 
converting portion (33) for rewriting a header of 
the source format according to an information 
about communicating conditions, said informa- 
tion memorized together with an image data 
when storing the image in a data storage por- 
tion (31), and according to a communicating 
capability of a receiving terminal in case of 
incapability of a receiving terminal to decode 
and reproduce a format of an image-informa- 
tion stored in the data storage portion (31); an 
image format converting portion (32) for con- 
verting image data into a source format receiv- 
able by the receiving terminal and a code 
amount control portion ( 34) for controlling an 
amount of codes of data to be transmitted, 
whereby in case of incapability of a receiving 
terminal to decode and reproduce format of 
image-information stored in the data storage 
portion (31), it rewrites only a part of the coded 
image-information to have a size and a format 
receivable by the receiving terminal, and then 
extracts and transmits said information to the 
receiving terminal. 
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